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(57) Abstract 

In a method and a de- 
vice for partial encryption and 
progressive transmission of im- 
ages, a first section of the im- 
age file is compressed at reduced 
Quality without decryption, and 
a second section of the unage 

access to appropriate o^ypuon 
keywords can decrypt this sec- 
ond section. The first section 
together with the decrypted sec- 
ond section can then ^ viewed 
as a full quality image. The stor- 
age space required for stonng the 
first and section together is es- 
sentially the same as the stor- 
age space required for stonng 
the unencrypted full quality rm- 
aee By using the method and 
otvice as described herein stor- 
age and bandwidth requirements 
for partially encrypted images is 
reduced. Furthermore, object 
based composition and process- 

ing of encrypted objects are fa- t be decrvptxd and restored in the compressed domain. 
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A METHOD AND A DEVICE FOR ENCRYPTION OF IMAGES 

TECHNICAL FIELD device fQr 

The present invention relates to a metnoa 
encrypting images. 

«ar*GROUND OF THE INVENTION AND PRIOR ART 

BACKGROUND OF technic al field which becomes 

Encryption of digital data information or 

._ nrtant when transmitting and storing secret xn 
important wne available to a user paying for 

information which only shall be avaiiac _ . 

£e information. Thus, several methods for encrypting *^tal 

are in frequent use. Such methods can also be applied also 
riigltal imagrdata. Examples of encryption methods are DES, 
triple DES and the public-key RSA method. 

Digital images can be stored on servers ^also 
telecommunication network "^^L^ I a CD-ROM. 
be distributed using a physical s g ^ ^ ^ 

Service ^"^^^^^ it might be suitable to 
thei r ™-; c ^ 1 ;/; o : e set of US ers and full access to 
offer partial access ^ data mugt be 

to all image data. 

be offered for sale on the Internet. 
News photographs can e.g. custon vers to download a 

The service provider wants to eva luation. 
version of the i«age with reduced quality fo ^ 

la that want to publish an image, pay 
journals, that wan * quality image, 

are then allowed to download a fun gu 

• o provider wants to minimize storage space 
However, such a service provider alternatively 
and download bit rates. An image P« cd _ r0Ms are given 

« t to distribute images on ^ view fche images at a 

away or sold for a low price. Cus ^ fuil 
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it is also essential that customers always can access images 
U sin 3 Zl friend, standee* software, image proves are 
reluctant to design and support special image viewers and 
customers don't want a proliferation of viewing tools. 

Presently, image providers have to store two versions of the 
i^ges stored. The full quality version is stored as an 
encrypted image file. This means that the image first is 
compressed and stored in a compressed file format such as JPEG 
TgIF. The compressed file is then encrypted using a suitable 
Lotion tool and an encrypted image file is stored The user 
„»st%irst decrypt this file and then access ^ resulting 
compressed image file us^g an image viewing too Reduced 
ouality images are produced by processing the full quality 
quality -ui»«3 ^ ^ r -tored as separate 

i.nages in an image- editing program. They are stored a 

compressed image files. 

^ problems with this solution 

. _ ^ f h v>~ same image need to be storea, 
= ^also be transmitted over the uetw or, in case - 

.„ case a customer first wanes to 

remote access in the case a resolution 
low resolution image before paying for the full 



version. 



.is results in a — e^ 

version image =°™ * ^ fmd £or sa le to Journals would 
information. Images that are of ^ ty 

» «f the full quality image, 
storage space of the xuxx H 

which is descrio includes many new 

verification Model Version 2.0. coding 

.nationalities in L^s for creating a 

:irrge oiTro^ ~ - — — 
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can select a suitable progression mode. 

within images can be accessed separately in the ™» »~ 
bitstream and progressive transmission can be applied also to 
ejects in 2000 there is also support for independently 

decodable coding units. 

iHTan object of the present invention to overcome the 
problems as outlined above and in particular to reduce the 
a^t of memory retired forstoring an image, which partial^ 
"all be possible to view, and also to reduce transmission time 
in a transmission scheme transmitting partially encrypted, 
images. 

This object and others are obtained by a technique for partial 
7 „ »„d oroaressive transmission of images where a first 

7™°« « £ ^ ^ - - — ssea " reducea T ity 

without decryption, i.e. the first low quality image- not 
encrypted, and where a second section of the image file » 

encrypted. 

- — — v~r r^scr^ z 

^Z^^z .en r:r 

^ge. The storage spacer equir ed or^tori g^ ^ ^ 

-""Vr s^g ^unencrypted full o^ality image. The 
reared fo ™ 9 sectioa ^ Spending on the 
encryption of the se ^ ^ ^ seoona 

encryption method, imply * a seo tion. 

section compared to the unencrypted secon 

, h . partitioned into multiple sections where 
The image can also be dividual encryption 

each section may be «W- - ^ ^ encrypted. 

m ethod and byword. Some ~ as aescr ihed 

Kn important element of the metn set o£ 

. nerein is that the compressed .mages con ist^f ^ 
independently decode coding units ^ onpressea 

possible to perform encryption °P« atl °^ 
domain without performing entropy decoding. 
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a reduced quality can be produced according to several 

different main schemes, such as: 

1) Reduced resolution .... 

2) Reduced accuracy o£ the transfer* coefficient^ 

3) Exclusion of predefined regions of interest (ROD 

m ese methods can be coined so that a reduced ^ 
e.g. produced by reducing both the resolution and the accuracy 
of the transform coefficients. 

By using the method and device for storing and transmitting 
ImagHata as described herein, several advantages are obtained. 
Zs there is no need to store two different versions of an 

. LfL Afferent users are to have access to different quality 
image if different u Erimslld ssion times become much 

of the one and same image. Also tr resoluti on. 
l«r if the information content of \- resollltion 

jjaage data can be reused when transmitting the highe 

image data. 

^^^™^Z described install and 
„!th reference to the accompanying drawings, in 

* »-v,o file structure of an image. 
. Fig. 1 is a general view of the file stru a=cordilig to 

Figs 2a and 2b shows encryption of images code 

^iH I- f-Thart illustrating some steps carried out 
"rrfdiagrLT Illustrating a client server process. 
Fig. 5 is a view of an encryption header 

DETAILED DESCRIPTION ^ q£ „ original , 

in Fig. 1. a general view of imag e data file 

hl9 h resolution, image is shown^ ^ decodaile coding 

consists of a number of " * tructur . shown in Fig. 

sections 101, 1.3 and 103. In the vM ot a Mgh 

X. the encryption and will therefore 

resolution image, is coae 

be possible to decode by any receiver . 
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• rfat-a which combined with the 

, h =d and only receivers having access to the correct 
T^TZ »U1 - able to decode the data stored in the 

section 103 . 

- 0Ae risfa which combined with the 
. . ^ -i n c which comprises data, wiiilu ww* 

r ta 9 :r «t ^ ^ * a ^ — — 

the high resolution i»age. is encrypted using a second 
eL^ion -nethod. and only receivers having acc, ... to the 
encryption Hey will be able to decode the data stored » the 
section 105. 

^s, decoding of the sect- ^ o£ the 

115. 

MC her.ore. indentation in * ™ ™ 3 Zl£££l 
«. see Charilaos chris^l . <ed , ^ ^ ^ 

^JTT - - inserted in the bitstrea, so that a „,de 
range of progressive modes can be supported. 

* i o n a coding unit is a part of 
- — 2000 T h trencodesTsPe= i£ ic bitplane of a given 
the bitstream that encoaes v described as any 

suhband. in general, a ^^/^^ion. «• 
independently ^^^Z order is to include so 

sr^r«i- -rreteturLder . . 

sufficient to specify the subband header that 

to own> . several specific ^^f^, the bits that 

defines a default codxng unr t orde t 

are needed for inserting «pl«« tags. 
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in Figs. 2a and 2b block diagrams describing how encryption can 
be implemented i» tie JPEG 2000 encoder end decoder 
respectively, are shown. 

Thus in Fig 2a a block diagram where encryption is performed 

entro'y coding in the encoder is shown. Coding units enter 
" entropy coding bloc, ,0!. xn the bloc, 20! coding the coding 
units are entropy coded using some suitable entropy cod* . The 
output from the bloc, 201 is fed to a selector which selects a 
suitable encryption method for each entropy coded coding unit, 
some coding units can be selected to not be encrypted at all. 

in response to the selection made in the selector 203 the 
entropy coded coding units are encrypted in a block 205. The 
"crated coding units together with the not encrypted coding 
^then form a combined output data stream, which can be 

stored or transmitted. 

Xn Fi 9 . 2b a decoder for decoding the bit stream generated by 
The enccaer in Fig. 2a is shown. Thus, first encrypte and not 
encrypted coding units enter the decoder via a selects 251. 

I ^selects a suitable decryption method for each entropy 
which selects a s re(:e ived coding unit is not 

coded coding unit, or if the receive 
encrypted it is directly transmitted to a block 255. 

» f o the selection made in the selector 255 the 
in response to the selec d in a D lock 2S3 using a 

entropy coded coding units are *£™ witB are 

suitable decryption algorithm. The 
th en fed to the block 255. Xn the . block 255 the 
fr om fed directly from the tQ £oro a co mbined 

block 253 are entropy ^ d ^ ° stream wh ich is fed 
output data stream corresponding to the data 
t o the entropy coding block 201 m Fig. 2a. 

E ach coding ^ ^~TZ^Z I^edTlock. 
Fi gs. 2a and 2b is ban* £ sepa rately with any user 

Bach coding unit can also be encryp ^ ^ ^ 

applied -^^^^.^flncryption methods. The 
can be encrypted witn am 
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encryption method used can further be an encryption aXgorithm 
coined with a keyword or a method for generate bywords . 

.■ ff „.nt encryption methods can in such an embodiment have 
identic! asthma but different Keywords. Encryption Method 
-scriptiof %»> as shown in Figs. 2a and 2b is any global data 
^h as sessL Key^rds or algorithm identifiers that is^eede 
to specify the Encryption Method, unit Encryption State <0ES> is 
a syTol that for each coding unit defines how it is encrypted. 

in Fig 3. a flow chart illustrating different steps carried out 
In Luting an image are shown. First, in a step 3 0 ^ 
image to be partially encrypted is received. The image received 
Tstep 301 is then coded using a coding algorithm generating 
^dlpendently decodable ceding units, e.g. ^ 2000. in a step 



303 , 



f« 305 some of the coding units of the image coded 
Next, in a step 305, some or C1litable encryption method, 

• 5 03 are encrypted using some suitable encryp 

m step 303 are en ry* chose n to be encrypted 

, _ nv c T he coding units that are cao&« 
such as DES. ine cuu » _ oforpnces Thus, a user can 

w am + <n accordance with user preferences. < 

can be set in accord^ hiqher order 

chose to have coding units =o = nd » = . ^ ^ ^ 

"-^--.tu.rsTh =h"ar not^ncrypted are merged into a 
and the coding units wnicn ^ 

single bit stream. 

In Fig. *. a flow chart ^^l^^^" 
„ te n transmitting an ^ ^ LL. Thus, a client 

described in conjunction with Fig. ^ ^ . ssue 

401 is — «d to a server « ,. c ^ ^ 

a request towards the server * 



405 



403 replies by transmitting the coding units of the 
The server 403 replies y ^ ^^ed 

im age which are not encrypted. ^ ^ ^ ^ 

coding units can be decoded y full image 

access to a low resolution ver = ~ ^ ^ ^ t 

Ba sed on this information £ ^ „ so the 

the image in a higher resoi 
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client transmits a request to the server requesting such 
information, step 409. 

The server replies by sending a request to the client requesting 
the client to agree to the conditions for transmitting the 
higher resolution version of the image, step 411. If the client 
agrees via a message 413, e.g. comprising a card number or 
account number from which to bill the cost for the image, the 
server sends the encrypted coding units together with a key word 
by means of which the encrypted coding units can be decrypted, 
step 415 A secure method for key distribution should be used. 
Examples of such secure methods are described in W. Stallings 

"Data and computer Communications", p 635 -637. Prentice-Hall, 

1997 fifth edition ISBN 0-13-571274-2. 

If the client already has access to the unencrypted and 
encrypted coding units, for example if he has purchased a CD-ROM 
withlmages coded as described herein. The scheme- as descried 
in conjunction can be modified so that no image data xs 
"ansmLted. Instead the client only agrees to conditxons set by 

nHerver in order to have access to the key wordCs w^ch are 
required to decrypt the encrypted coding unxts of the CD ROM. 

in the case when the method and device as described herein is 
U sed when encoding image according to the ™» 

i. advantageous if the o» 2000 <^^^££T*~ 

^. * n FncrvDtion Header tnat is xnuxu^ 

SaC ^17TZ'^T^Z Encryption *a 3 *«= is ^ 
ZTaZZo rZ -n Jt- >e used to specify - co-i* 

units are decrypted. 

-*~limant the JPEG 2000 image header contains an 
in such a* -*»^ e ^ set i£ ^ codlng unit is 

Kncryptron .la » ^ ^ ^ ^ & to 

optionally be merged into JPEG 2000 Tags. 

In Fig 5 an encryption header is shown. The Encryption Header 
can In such an e^cdi-ent contain the flowing sy^ols . 

SUBSTTTUTE SHEET (RULE 26) 
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1) Encryption Mode (EM) . A set of standard encryption modes are 
defined e.g. 

a) One encryption, method is used for all coding units 

b) Bitplanes of less significance than bitplane X are encrypted 

c) Subbands of higher resolution than Y are encrypted 

d) ROIs specified in are encrypted, etc. 

No encryption information need to included in the Tags if an EM 
is defined. 

2) Encryption Mode Parameters (BMP). Parameters (X, Y, ...) that 
are used to define the Encryption Mode are set here. 

3) Number of encryption methods used. Several encryption methods 
can be used within the same image if e.g. different user groups 
should be allowed to see different image content. 

w~4->^/i r>«=.scribtor (EMD) for each encryption 

4) One Encryption Method Descriptor vr^/ 

method The EMD defines any data that is needed by the 

t^rt^r : x ;;^ * ----- -zr a 

e—ym ^c-rvotincT the enclosed encrypted key. me 
P t /Lv i a fast decryption alsorithm to decrypt 

d ecrypted *ey » used y ^ ^ al ic=ates an number to 

e^ryptsd and if ~ by ^ Ihese 

rr U ld eitt" \ CO l^ed in the encryption header or 
symbols could either h i tst ream as encryption 

alternatively be distributed in th . b1 ""^ tion header we 
tag s. If the OKS information is Kept i the ryp ^ 
Qef ine a header element - Encryptio State BS, . ^ 
a series of TOS symbols that are listed in the 
coding units appears in the bit stream. 

« et-»rp is not given in the 
IF EF is set and the Encryption State n 
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* JPEG 2000 Tags can be expanded to contain Unit 

^iol -ate («,. sy^ols. OES defines which ^ 
if any, that i, used for encrypting the next coding 

unit . 

The transfer*, coefficients belonging to a HOI can be handled as 

by selecting appropriate coding units belongrng tc the KOI 

encryption. 

The »ain problem is that the shape of the HOI Mght ~-al J*e 
content, xf the shapes are encrypted it is. however 
to show a reduced quality i-age since it is difficult to 
interpret the coded transform coefficients. 

wi— =an be solved by defining a so called cloaking 

-it:^t. is. t - r; rr :r - ~~ 

- - - 

shape is a bounding box. 

->« oat in the JPEG 2000 bit 
A c-shape is - c ^;^ ^encryption as described in 

r^'^r^ - : " =- - the ~ Ea 2000 

header . 

A ^ is created ^^^J^Zr^ 
coefficients belonging to the c s P ^ that 

using the method as described ™' are shield ed 

al l coefficients belongs t<> any of ^ ^ ^ 

by the c-shape are encrypted. The te* 
protected by encryption. 

T he shape of ^^^^^ ^ 
encryption header. The encryp nding c-shape. 

. — — ^ Tore iT^ZJ^^. T he c- 
The decoder can now aecouc 
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„ can be displayed as a blank region. The original ROIs can 
! Td if tne keyword is known. This is done by decrypting 
"e S o n ^ging to the c-shape. The shape of each ,0! 
longing to the c-shape is also decrypted. The bitstream can 
now be rearranged so that the =-shape is dropped and the 
original E OI data structures are restored. Hote that thrs „ 
done in the compressed domain. 

The mask that is used for encoding a RO! is not uniquely defied 
in JPEG 2000. X mask that is sufficiently large so that the ROI 
Z encoded lossless will often cover the whole lower 
mlsk that is not allowed to expand will lead to a lossy encoding 
" the ROI. The masks belonging to different ROIs or to a ROI 
andte background can be designed to overlap. This means that 
some coefficients are encoded in more than one ROI. such 

■ii to a reduced overall compression but the rois 

ZTZ: ZZZ - ^t any ROI can be accessed and decoded 
with a good visual result. 

-wi for ROIs described herein is not 
The partial encryption method fo R°I* ^ ^ 

dependent of from the 

so that the content o£ a kux m(at - ho d for building a 

con tent of any other ROI or £££ ta ^rilaos 

— «*" " 0 -ification Model version 2 .0. 

christopoulos (ed.), -J"" 

.v. s „ d device as described herein storage and 
By using the method and encrypted images is 

bandwidth requirements ^J^l^Z^ and processing of 
r educed. Furthermore. ob,ec ^ based p ^ ^ 

encrypted o bj e cts are f cil^. ta te^ ^ ^ 

t£* -"TJU^ and restored in the compressed domarn. 

■ .other advantage is ^^^t^Z^s^ 
performed at the same time ^ ^Jsse* domain (at the 
th e process takes place rn the c mp ^ ^ ^ ^ 
bitstream syntax) it > P per£o rmed just before 

encryption. The (tran scoder, . In this case, 

transmitting the image by a parser 

SUBSTITUTE SHEET (RULE 26) 



WO 00/31964 



PCT/SE99702106 



« t n= rrr s : srj^r 

if the encryption is pi^ c added before 

is avoided and the encryption infortnatn.cn is only added 

transmitting it. 
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CLAIMS 

X. A -ethcd of partially encrypting image data comprising the 

fcoaimg'the i-» data using an ceding algorithm generating 
independently decodable coding units, 

- encrypting at least one of the coding uuxts, and 

- Ter^ng elding units which are not encrypted with codxng unrts 
which are encrypted into a combined bitstream. 

2 A method according to claim 1. characterised i* that the not 
encrypted coding units correspond to a low resolution version of 
the image data. 

3 a method according to any of claims 1 - 2, characterised in 
that Cerent coding units are encrypted using different coding 
methods . 

* ^^™« l - 3, characterised in 

4 A method according to any of claims 1 3, 

™*i 0 n flag which indicates if a codxng uiut.is 
that an encryption flag, ^iu. 
encrypted, is inserted in the bit stream. 

. bairns i - 4, when information 
.. a method Merest u — . 

Z tha^e shape of the region of interest „ 
enclosed in a cloaking shape. 

.■ A device for partial encryption of image data character-* 

Yearns for coding ^^^^^^^ 

r^tng means for encrypting at least 

one of the *^ ^ n ^ it3 „nich are not encrypted wit* 

;;r;rtsTirr enLypted. 

characterized by means for 
7 . a ^^^^Z^ - -responding 

selecting the not data . 
to a low resolution version of the im g 
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- claims 6 - 7. characterized by 
a A device according to any of claims 6 /, _ 
devic ai£feren t coding units using different 

-means f or" encrypting differs COttuy 

coding methods- 

, A device according to any of claims 6 - 8, C^acteri^' 

<~ i— tl., an encryption flag, which indites - - 
coding unit is encrypted, in the bit stream. 

10 A device according to any of claims • - characterized toy 
^enclosing a region of interest shape in a cloaKmg 

shape. 
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